BARI-TH/00-388 

CERN-TH/2000-185 

DSF-2000/22 

UGVA-DPT/2000-06-1085 



B and Bg decays into three pseudoscalar mesons 
and the determination of the angle 7 of the unitarity triangle 



A. Deandrea'^, R. Gatto^ M. Ladisa^ G. Nardulli'= and P. Santorelli'^ 



° Theory Division, CERN, CH-1211 Geneve 23, Switzerland 
^ Departement de Physique Thcorique. Universitc de Geneve, 
24 quai E.-Ansermet, CH-1211 Geneve 4, Switzerland 
Dipartimento di Fisica, Universita di Bari and INFN Bari, 
via Amendola 173, 1-70126 Bari, Italy 
Dipartimento di Scienze Fisiche, Universita di Napoli "Federico IP 
and INFN Napoh, Via Cintia, 1-80126 NapoU, Italy 



Abstract 

We reconsider two classical proposals for the determination of the angle 7 of the unitarity 
triangle: Xcot^ tt+tt^tt^ and Bs — > p^Ks tt^tt^Ks- We point out the 

relevance, in both cases, of non resonant amplitudes, where the tt'^tt^ pair is produced by 
weak decay of a B* [J^ = 1^) or B^ {J^ = 0+) off-shell meson. In particular, for the B 
decay channel, the inclusion of the Bq pole completes some previous analyses and confirms 
their conclusions, provided a suitable cut in the Dalitz plot is performed; for the Bg decay 
the inclusion of the B*, Bq amplitudes enhances the role of the tree diagrams as compared 
to penguin amplitudes, which makes the theoretical uncertainty related to the Bg — > p^Kg 
decay process less significant. While the first method is affected by theoretical uncertainties, 
the second one is cleaner, but its usefulness will depend on the available number of events 
to perform the analysis. 
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We reconsider two classical proposals for the determination of the angle 7 of the unitarity triangle: 
B^ — > XcOTT* Tv~^TT~Tv^ and Bs p^'Ks tx^-k~ Ks- We point out the relevance, in both cases, 
of non resonant amplitudes, where the ■n^Tv~ pair is produced by weak decay of a B* (J^ = 1~) 
or Bo {J^ =0^) off-shell meson. In particular, for the B decay channel, the inclusion of the Bo 
pole completes some previous analyses and confirms their conclusions, provided a suitable cut in the 
Dalitz plot is performed; for the Bs decay the inclusion of the B* , Bo amplitudes enhances the role 
of the tree diagrams as compared to penguin amplitudes, which makes the theoretical uncertainty 
related to the Bs — > p^Ks decay process less significant. While the first method is affected by 
theoretical uncertainties, the second one is cleaner, but its usefulness will depend on the available 
number of events to perform the analysis. 



I. INTRODUCTION 

In the next few years dedicated e+e~ machines at Cornell, SLAG and KEK and hadronic machines such as LHG 
will explore in depth several aspects of CP violations in the realm of i?-physics. In particular the three angles a, (3 
and 7 of the unitarity triangle will be extensively studied not only to nail down the Cabibbo-Kobayashi-Maskawa 
(CKM) matrix and its encoded mechanism for CP violations, but also to examine the possibility of deviations from 
the pattern expected in the Standard Model. Some analyses, based on combined CDF and Aleph data on sin 2/3, 
sin 2/3 = O.82IO.39, as well as on CLEG results and other constraints on the unitarity triangle, have been already 
used in Q| to get limits on the three angles a, (3 and 7. Although preliminary and based on a number of theoretical 
inputs, these results are worth to be quoted, as they represent theoretical and phenomenological expectations to be 
confirmed or falsified by the experiments to comeQ 

13 = 24.3° or 65.7° (1) 
7 = 55.5t°:g (2) 

a = TT — /3 — 7 . (3) 

The first angle to be measured with a reasonable accuracy will be (3, by the study of the channel B J/ipRs, which is 
free from the theoretical uncertainties related to the evaluation of hadronic matrix elements of the weak Hamiltonian. 
A few strategies for the determination of a have been also proposed, most notably those based on the study of the 
channels B ^ tttt and B — *■ /ott Q , Q| . For this last channel a recent analysis Q has stressed the role of non-resonant 
diagrams where one pseudoscalar meson is emitted by the initial B meson with production of a B* or a positive parity 
Bq {J^ = O"*") virtual state followed by the weak decay of these states into a pair of light pseudoscalar mesons. 

One of these diagrams (the virtual B* graph) has been examined also by other authors in the context of the 
determination of 7 Q , ||] , . It is useful to point out that 7 appears at present the most difficult parameter of 
the unitarity triangle. In the recent years several methods have been proposed to measure this angle; some of them 
are theoretically clean, as they are based on the analysis of pure tree diagrams at quark level, such as 6 ^ ucs and 
b cus transitions. One of the benchmark modes was proposed in pdj and employs the decays B^ D'^K'^, 



^The fitted value of sin 2/3, which corresponds to the value mh, is sin 2/3 — 0.7501q 



+0.058 
064 



1 



D^K^ and i3+ Dj^K~^, where Dj_ denotes CP eigenstates of the neutral D meson system with CP 
eigenvalues ±1. The difference of the weak phases between the — > D^K^ and the D'^K'^ amplitudes is 

27, which would allow to extract the angle 7 by drawing two triangles with a common side: one of the triangles 
has sides equal to A{B+ D°K+), A{B+ D^K+) and ^/2A(B+ D\K+) respectively, and the other one has 
sides A{B- WK-) = e-2n^(5+ ^ D^K+), A{B- D°K-) = A{B+ WK+) and V2A{B- D\K-). 
Even though this method is theoretically clean, it is affected by several experimental difficulties (for a discussion see 
[Q). One of these difficulties arises from the need to measure the neutral D meson decays into CP eigenstates, but 
also the other sides of the triangles present difficult experimental challenges. For example, if a hadronic decay (e.g. 

— > K~TT'^) were used to tag the D'^ in the decay B^ D'^K^, there would be significant interference effects with 
the decay chain B^ D'-^K^ K^tt^K^ (through the doubly Cabibbo suppressed mode K^tt^); if, on the 

other hand, the semileptonic channel Z?" l^viXg were used to tag the there would be contaminations from the 
background _B+ i^viXc- 

The other benchmark modes for the determination of 7 discussed in the recent review prepared for the Large 
Hadron Collider at CERN [|l2| have also their own experimental difficulties; for these reasons we consider worthwhile 
to consider other channels, already discussed in the past and somehow now disfavored because of their more intricate 
theoretical status. Wc are aware of these theoretical difficulties and it is the aim of the present paper to discuss them 
in some detail for two methods proposed for the determination of the angle 7. The first method was proposed in |^ 
and discussed subsequently by other authors ||] , : it is based on the idea to analyze the charged B CP-violating 
asymmetry, which arises from the interference between the resonant (at the invariant mass m^^^ — 3.417 GeV) and 
non-resonant (the virtual B* graph) production of a pair of light pseudoscalar mesons in the decay B — *■ 3 light 
mesons. It is an aim of the present work to complete the analyses in j^-p^] by considering the channel B — > 37r, 
including also the contribution of the virtual positive parity Bq (J^ = 0^) state and the gluonic penguin operators. 
We shall therefore analyze the robustness of the conclusions in |^ and |10| once these additional contributions are 
considered. 

The second analysis we consider here is the possible determination of 7 by means of the Bs P^Ks decay mode. 
Also this process has been considered in the past ||l^, but it is presently less emphasized because the tree level 
contribution, that one hopes to estimate more reliably, is suppressed by the smallness of the Wilson coefficient ai. 
As we shall notice below, the non-resonant tree contributions to this decay (i.e. B* and i?o) are proportional to the 
large Wilson coefficient 02 (02 ~ 1); therefore we expect that their inclusion can reduce the theoretical uncertainties 
arising from the penguin terms. This channel could be a second generation experiment provided a sufficient number 
of events can be collected, once x^, the mixing parameter for the Bs — Bg system, and (3 have been determined by 
other experiments. 



II. B xcoTT DECAYS 

We consider in this section the decay mode 

B^ tt+tt^tt" , (4) 

as well the CP-conjugate mode B^ 7r^7r+7r+, in the invariant mass range 771^^+^- ~ "t-Xco — 3.417 GcV. For this 
decay mode we have both a resonant contribution coming from the decay B~ — > Xco^r^ — > 7r+7r~7r~ and several non 
resonant contributions. According to the analysis performed in pO| ], this decay mode can be used to determine 
sin 7 by looking for the charged B asymmetry arising from two amplitudes: the resonant production via Xco decay and 
non-resonant amplitudes. Among the non resonant terms, we have included the B* pole, which is the largest among 
the contributions considered in |^] |^ The authors in |ic[| have considered other decay modes in the same kinematical 
region, by analyzing the partial width asymmetry in B^ AIMn^ decays {M = 7r+, /^+, tt", 77). Spotting the decay 
mode B^ tt+tt^tt^, they estimate an asymmetry given approximately by 0.33 sin7, which, however, seems to be 
sensitive to the choice of the parameters |lo| . 



Other less important terms discussed in [g] include a long-distance type diagram, where an intermediate highly off-shell pion 
is exchanged among the incoming B meson and the outgoing pions, and a short-distance diagram, where the outgoing pions 
are produced in a point-like effective interaction by the weak decay of the B meson; we agree with the authors in on the 
smallness of these neglected terms. 
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Our interest in this decay channel has been triggered by the study of a different invariant mass region (i.e. mTTTr — 
TOp) 0, where also the contribution of the Bq pole {J^ = 0+, with an estimated mass 5.697 GeV) was found to be 
significant; therefore we include it in the present analysis, which represents an improvement in comparison to previous 
work. The second improvement wc consider is the inclusion of the gluonic penguin operators. We refer to the paper 
for a full discussion of the formalism and we list here only the relevant contributions A^^^, Ab' and Ab„ to the 
decay amplitude: 



A^ 



A, 



1 



t — + i TTiv n „ s — ml, + i „ „ 



n(t, u) 



+ 



n(s,u) 



t — m^, + i rriB' Fg* s — m^, + i rriB' Ti 



Abo = Kbo ( m^Bn - TTT^i ) 



(5) 



where 



Il{x,y) = ml 
In (|^) the values of the constants are: 



y 
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iCx = 1.52 10' 



Vub "2 - ^tb 04 - ag 



mq { mb + mq ) 



mB 
mBo 



'Bo 



2 ^ pBTT 



Kb Kd a2 - Vtb Vt 



td 



a4 — ag 



mg { mb + mq ) 



The numerical value in (|^) is derived in |^ , where the resonance amplitude is given by 

i?(s) = ai Q!2 - 



XcO 



i r 



(6) 

(7) 
(8) 

(9) 
(10) 



XcO 



'XcO 



Normalizing the decay rate of 



XcOT^ 



TT+TT 7r+ by the total B decay rate, the product ai a2 in (toh is given 



by the product of the corresponding branching ratios : 

Br{B+ ^ Xco) X Brixco 



2 TT a? an 



(11) 



the product of the branching ratios in ( pi] ) is estimated to be about 5 x 10 ^ , which gives the numerical value 

As to the numerical values of the constants appearing in (||) and (^, we use the same values adopted in Q : 
g = 0.4, h = -0.54, mB- = mB = 5.28 GcV, ms„ = 5.697 GeV, Tbo = 0.36 GeV, Tb- = 0.2 KeV, mb = 4.6 GeV, 
mq « m„ « md — 6 McV, Aq = 0.16, Ff^'^ = —0.19. These numerical estimates agree with results obtained by 
different methods: QCD sum rules |]l^, potential models |15|, effective Lagrangian ||l^, NJL-inspired models |0 . 
Moreover we use the following values of the Wilson coefficient : Ci -0.226, C2 = 1.1, C3 = 0.012, C4 = -0.029, 
C5 = 0.009 and Cg = -0.033 , with 02 = C2 + Ci/3, ai = Ci + C2/3. The Wilson coefficients arc obtained in the HV 
scheme lisll, with aI^^, = 225 MeV, /i = fhb{mb) = 4.40 GeV and mt = 170 GcV. For the CKM mixing matrix |l|] 



MS 



we use the Wolfenstein parameterization |20|]: Vub = A A (p — irj), Vtb = I, Vud = 1 — A /2, Vtd = A \^ {1 — p — irj), 
Vcb = A A^, Vcs = 1 — A^/2 and 14s = —A A^. Wc take A = 0.22 and A = 0.831; moreover, since r/ is better known 
than p we take it at the value provided by the present analyses of the CKM matrix: ry = 0.349 . It follows that p 
will be given, in terms of 7, hy p ~ rj/ tan 7. 
The asymmetry is given by 



A 



T{B+ 7r-7r+7r+) - r{B- tt+tt-tt-) 
r(B+ 7r-7r+7r+) + r(B- tt+tt-tt-) 



(12) 
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By introducing only the XcO and B* contributions, we reproduce, within the theoretical uncertainties, the results 
of [Tc| ]. However the introduction of the Bq pole contribution dramatically reduces the asymmetry, because this 
contribution to the asymmetry is opposite to the B* term. We have observed that this cancellation arises from a 
change of sign around the XcO resonance and therefore we change a little bit the procedure by defining a cut in the 
Dalitz plot. We integrate in the region defined by 

^Xco - 2 ^xao <Vs< m^^o + 2 r^^n , 

TOXcO < , (13) 



'XcO - 2 r^^,, <Vt< m^.o + 2 r^.o 



m 



'XcO 



< V~s , (14) 



where r^^^ = 14 McV. It may be useful to observe that the integration over the whole available space in the 
Mandelstam plane around the XcO resonance gives Br{B'^ — > 7r^7r~7r+) ~ Br{B^ 7r~7r^"7r+) = 5.27 X lO"'^ and 
therefore the cut-off procedure introduces a reduction of a factor 5 in the branching ratio. 

For the asymmetry wc obtain the result in Fig. |^. For 7 ~ 55°, it can be approximated by Acut = 0.48 sin 7. 
In order to assess the relevance of the Bq pole, we report in Table | the contribution to the branching and to the 
asymmetry of the different contributions for a particular value of sin 7. 

We observe that the inclusion of the next low-lying state Bq does not alter significantly the conclusions obtained 
in previous works, where basically only the B* non-resonant term was considered; however this conclusion can be 
obtained only if a convenient cut in the Dalitz plot is included. We also observe that the calculations performed in 
this section are not sensitive to the inclusion of the gluonic penguin contributions. 

To get an estimate of the dependence of our result on the parameters, we considered the following intervals for the 
couplings g and h. For h = —0.54 and g = 0.4 ± 0.1 we obtain (at sin7 = 0.82) an asymmetry Acut ~ 0.41^q °2; for 
g = 0.4 and h = —.54 ± 0.16 we have an asymmetry Acut = 0-41^o o4- The corresponding variation on 7 is extremely 
large (30° to 150° degrees) because the asymmetry is rather flat in that region. We conclude that due to the theoretical 
uncertainties inherent to this method, the channel XcO"" can hardly be useful for a precise determination of the angle 
7- 

III. Bs -> p°Ks DECAY 

In the decay Bg p'^Ks the final state is a CP eigenstate; in this case one can measure either the time dependent 
asymmetry 

^ nB,{t) ^ pO/vg) - T{Bs{t) ^ pHis) 
""'^^ nBS)^p'Ks) + nBS)^p'Ks)' ^ ^ 

or the time integrated (t > 0) asymmetry: 

_ /o°°rft [T{B,,{t)^p^Ks) ~ Tmt)^p^Ks)] 

' j^dt [T{B,{t)^ p^^Ks) + nBS)^ p'^Ks)] ■ ^ ^ 

Let us define 

xs = (17) 

where Ams is the mass difference between the mass eigenstates and F w r(i?s) w ^{Bs) and 

A = A{Bs^p''Ks), A = A{Bs'^p''Ks) (18) 

A = \AT\e'^'t"^+'<^ + |Ap|e*('^^-'^) (19) 
A = \AT\e'^'t'^-''^ + |Ap|e*('^^+'^) . (20) 
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Here (pT and (pp are strong phases of the tree and penguin ampUtudcs, \At\ and \Ap\ their absolute values and (3 and 
7 the weak phases of the and V*^^ CKM matrix elements. The mixing between Bs and Bg, parameterized by the 
Xs parameter in jT?! ) introduces no weak phase. 

Both the diagram (fig. ^ and the B* , Bq non-resonant diagrams, with a cut in the 7r+, 7r~ pair at mTrjr ~ 
rup ± 2Tp (fig. 1^) contribute to At and Ap, that are therefore given as follows 

A^ = |^T|e'(^-+-)=Aj + A^.+Ai„, (21) 
Ap = \Ap\e'^^--P'^ =AP + Al, + A%^ . (22) 

The amplitudes are computed in the factorization approximation from the weak non leptonic Hamiltonian as given 
by p^]; our approach is similar to the one employed in rcf. ||^ where a full description of the method is given. We get 
(Q = r,P): 



^ u — + i rUp Tp 

A^^ — I\- It — 

U — nig, + I ITlB* 1 B' 



(23) 



where 



U = { Ptt- + Ptt+ ) , t = {pK +P^- ) , t' = { PK + P^+ ) ■ (24) 

In (|2^) the values of the constants are : 

kJ = Kd ai .gpTTTT /p , (25) 

< - ^ Vtb a, gp^^ fp Ff^'' , (26) 

Kl, = 4 Af - ^ Vub a^g ^ rup^ mp, , (27) 
V2 

At. = - 4 - ^ V:, Vt, f a4 - ae ^^^^^^ r ) 9 ^ mp^ mp, , (28) 

V2 V TTlq { mb + niq ) J Jk 

^^Bq ^0 ■ ^ Kd Vub a2^mp„ ms, /i , 29 

r^P pBorr "^Iq - Gf ( rnj \ hU 

71 r^~"^ ( ) J ^"""^^i^ ' ^^0) 

where 5p^^ = 5.8, /p 0.15 GcV^ pl|, nip = 770 MeV, Tp = 150 MeV, 130 MeV, = 161 MeV, F^°'^ = -0.19, 
pB^K _ —Q iQ jyig^ — 5 37 GeV [07 From these equations the parameters appearing in (pT|), ( p2| ) can be obtained. 
The time integrated asymmetry is 

_ Xs [sin 27 - ai sin 2/3 - 2q;2 sin(/? - 7)] - 20:3 sin(7 + /3) 
(1 + x2) [1 + ai + 2a2 cos(/? + 7)] 



Numerically we obtain: 



J dn\Ap 



2 



j dncos{(j)T- <I)p)\ApAt\ 

= Jd^M^ = ' 

S dn^iniPr ~ Pp)\ApAt\ 
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In these equations integrations are performed in a band around the p mass: rup ± 200 MeV. 

For illustrative purposes we consider the value Xs = 23, (3 = 65. 7*^ and 7 ~ 55.5", corresponding to the central 
values in one obtains an asymmetry of 3.5% ^ 

It can be observed that the channel Bs — > p'^Ks has been discussed elsewhere in the literature ||2^, but somehow 
discarded for two reasons. First the asymmetry contains a factor Xs/{1 + x^) which, in view of the large mixing 
between Bs and Bs, is rather small. Second, as it is clear from eqs. (30), the ratio of the penguin to the tree 
amplitudes can be large, if one includes only the p'^-resonant diagrams ^; indeed the p^ contribution is proportional to 
the Wilson coefficient oi which is small. As to the first point a small asymmetry can still be useful for determining 7 
provided a sufficient number of events is available (see below) ; as to the second point the inclusion of the non-resonant 
contribution B* , Bq is of some help in this context, as the tree contribution is proportional to the Wilson coefficient 
a2 — 1.0 for these diagrams. 

A reliable estimate of the branching ratio is difficult (because of the uncertainty on the oi parameter). The effect 
on the asymmetry is to reduce the influence of the penguin operator in the final result as can be deduced from eq. 
( ^ ) . In order to assess the validity of the method for the determination of the asymmetry, we varied the penguin 
contribution by varying the parameters of cq. (^2|) by 50% 0. Our results for the asymmetry vary by 10% (assuming 
7 = 55.5°) and the value of 7 that one can deduce is 55.5^5 degrees due to this uncertainty. 

In fig. (^) we report the asymmetry as a function of the angle 7 (for Xg = 23 and two values of /3). 

Let us conclude this analysis with a discussion on the reliability of the Bs decay mode for the determination of 7. 
An estimate of the sensitivity of the method can be obtained by comparing it, as an example, to B^ — > J/^Ks- The 
branching ratio for Bg — *■ J/'^Ks is expected to be 2.0 x 10^^ |lj], while the branching Bs p^Ks is roughly one 
order of magnitude smaller ^. The event yield for the Bs J/'i'Ks channel is estimated to be 4100 event per year 
by a selection method developed by the CMS collaboration at the LHC (with a pr cut > 1.5 GeV/c on the pions 
from the Ks decays to suppress the combinatoric background). Assuming a similar selection method for Bs p'^Ks, 
one could obtain ~ 410 events per year and ~ 2 x 10'^ in 5 years, which would produce an uncertainty of ±17° on 
7 (assuming Xs = 23 and 7 ~ 55°) to be compared to the estimated error of ±9° degrees within 3 years at LHC 
for Bs — > J/'i'Ks- Therefore even if the mode Bg p^Ks is less competitive than the Bs J /'^Ks one, it is not 
dramatically so if the branching ratio is not too small, and could be considered as a complementary analysis for the 
determination of 7. The final assessment of the feasibility will be clear as soon as an experimental determination of 
the branching ratio for Bg p^Ks is available. 



IV. CONCLUSIONS 



In this paper we have reviewed two classical methods proposed in the past few years for the determination of the 
angle 7: B^ XcO^^^ 7r+7r~7r^ and Bg p^Ks ■k^-k' Ks- For the first decay channel we have included, 
besides the B* non-resonant diagram, the i?o [J^ = 0+) off-shell meson contribution. This calculation completes 
previous analyses and confirms their results, provided a suitable cut in the Dalitz plot is performed; however it appears 
that this method is subject to a large uncertainty on the determination of 7 coming from the allowed variation in 
the theoretical parameters because the asymmetry is rather flat in the region of interest. For the second channel 
we have pointed out the relevance of the two non-resonant amplitudes, i.e. the mechanism where the tt+tt" pair is 
produced by weak decay of a B* {J^ = 1~) or Bq {J^ = 0+) off-shell meson. The inclusion of these terms enhances 
the role of the tree diagrams as compared to penguin amplitudes, which makes the theoretical uncertainty related to 
the Bg — > p^Ks decay process less significant. This method can be considered for a complementary analysis for the 
determination of 7, provided a sufficient number of events can be gathered. 



^For the solution f3 — 24.3" and the same values of 7 and Xs one gets for the asymmetry again 3.5% as the coefficients qi, 
02, as are small and the asymmetry can roughly be approximated by sin 27/3:3. 

^without the B* and Bo contribution the parameters of eq. would be larger qi = 0.26, 02 = —0.27, as — —0.45 

^The reason could be a violation of factorization or a variation in the parameters used to estimate the penguin contribution. 

®The precise value critically depends on the parameter oi which is the result of the partial cancellation of the Wilson coefficient 
ci and C2 and on the validity of the factorization approximation. In |2^] an estimate of (1±0.5) x 10~® is given; with the values 
adopted in the present paper we get 2 x fO"'^ because a much smaller value of 02 is used. Note however that the asymmetry 
is largely independent of the precise values of the parameters used to obtain the branching ratio. 
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FIG. 1. Asymmetry as a function 7 for B — > XcO^- 
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FIG. 2. The p Feynman diagram for the Bs — > Ks tt^ 7r+ 
decay. The circle and the box represent, respectively, the 
strong and the weak interaction vertex. 



FIG 



B, 




Feynman diagrams for the 
decay. The circle and the box represent. 



respectively, the strong and the weak interaction vertex. 
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FIG. 4. The relevant asymmetry in the decay channel 
Bs —* Ks TT^TT^ as a function of 7. The solid line corre- 
sponds to /3 = 24.3° while the dashed one to /? = 65.7° 
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Br{B' 7r"7r"7r+) 
Br{B+ 7r"7r+7r+) 



cut 
cut 



Xco + B* 
1.18 X lO"'^ 
1.48 X lO"'^ 
0.11 



Xco + B* +Bo 
1.06 X lO"'^ 
2.54 X lO-'^ 
0.41 



TABLE I. Different contributions to the branching ratio 
and asymmetry in the decay channel B^ — > n^n^n'^ . Both 
branchingratio and asymmetry are cut off according to the 
rules in (13l|l|) and sin 7 = 0.82. 
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